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Mutual Information as Privacy-Loss Measure 
in Strategic Communication 


Farhad Farokhi and Girish Nair 

Abstract —A game is introduced to study the effect of privacy 
in strategic communication between well-informed senders and a 
receiver. The receiver wants to accurately estimate a random vari¬ 
able. The sender, however, wants to communicate a message that 
balances a trade-off between providing an accurate measurement 
and minimizing the amount of leaked private information, which 
is assumed to be correlated with the to-be-estimated variable. The 
mutual information between the transmitted message and the 
private information is used as a measure of the amount of leaked 
information. An equilibrium is constructed and its properties are 
investigated. 


1. Introduction 

Participatory and crowd-sensing technologies rely on honest 
data from recruited users to generate estimates of variables, 
such as traffic condition and network coverage. However, 
providing accurate information by the users undermines their 
privacy. For instance, a road user that provides her start and 
finish points as well as the travel time to a participatory- 
sensing scheme can significantly improve the quality of the 
traffic estimation; however, such reports expose her private life. 
Therefore, she benefits from providing “false” information, not 
to deceive the system and disrupt the services but to protect 
her privacy. The amount of the deviation from the truth is 
determined by the value of privacy, which varies across the 
population. To better understand this effect, here, we use a 
game-theoretic framework to model the conflict of interest and 
study the effect of privacy in strategic communication. 

Specifically, we use a model in which the receiver is inter¬ 
ested in estimating a random variable. To this aim, the receiver 
ask a better-informed sender to provide a measurement of the 
variable. The sender wants to find a trade-off between her de¬ 
sire to provide an accurate measurement of the variable while 
minimizing the amount of leaked private information, which 
is potentially correlated with that variable. We assume that 
the sender has access to a possibly noisy measurement of the 
variable and a perfect measurement of her private information. 
We use the mutual information between the communicated 
message and the private information to capture the amount 
of the leaked information. The sender balances between her 
two desires using a privacy ratio. We present a numerical 
algorithm for finding an equilibrium (i.e., policies from which 
one has an incentive to unilaterally deviate) of the presented 
game. We also construct an equilibrium explicitly for the case 
where the message and the to-be-estimated variable belong 
to the same space. Using a numerical example, we illustrate 
the relationship between the quality of the estimation at the 
receiver and the privacy ratio. In turns out that, at least for 
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Fig. 1. Communication structure between the sender S and the receiver R. 


the presented example, there exists a critical value for the 
privacy ratio below which the sender honestly provides her 
measurement of the variable. 

Strategic communication has been studied in the economics 
literature in the context of cheap-talk games [l]-[3] in which 
well-informed senders communicates with a receiver that 
makes a decision regarding the society’s welfare. In those 
games, the sender(s) and the receiver have a clear conflict 
of interest, which results in potentially dishonest messages. 
Contrary to those studies, here, the conflict of interest is 
motivated by the sense of privacy of the sender, which changes 
the form of the cost functions. Furthermore, in this paper, we 
are dealing with discrete random variables which is different 
from the studies on cheap-talk games. Cheap-talk games were 
recently adapted to investigate privacy in communication and 
estimation [4]. That study, however, focuses quadratic cost 
functions and Gaussian random variables. In this paper, we use 
the mutual information as a measure of the leaked information 
and study the more realistic setup of discrete communication 
channels. 

The problem considered in this paper is close, in essence, 
to the idea of differential privacy and its application in 
estimation and signal processing, e.g. [5]-[7]. Those studies 
rely on adding noise, typically Laplace noises, to guarantee 
the privacy of the users by making the outcome less sensitive 
to local parameter variations. In contrast, here, we find the 
optimal “amount of randomness” that needs to be introduced 
into the system for preserving the privacy by modelling the 
communication as a strategic game and studying its equilibria. 

In the information theory literature, wiretap channels have 
been studied heavily dating from the pioneering work in [8]. In 
these problems, the sender wishes to devise encoding schemes 
to create a secure channel for communicating with the receiver 
while hiding her data from an eavesdropper. However, in 
the privacy problem, the objective is different, that is, the 
sender want to hide her private information (not necessarily 
all the data possessed by her) from everyone including, but 
not limited to, the receiver. 

Note that information theory has been used in the past 
in networked control under communication constraints, e.g., 
see [9]-[13]. However, to the best of our knowledge, it 
has not been used to measure the privacy loss in strategic 
communication as in this paper. 

The rest of the paper is organized as follows. The problem 
formulation is introduced in Section II. The equilibria of 
the communication game are constructed in Section III. The 
results are extended to the multi-sender case in Section IV. 
Section V discusses the numerical example. The paper is 
concluded in Section VI. 
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IT Problem Formulation 
We consider strategic communication between a sender and 
a receiver as depicted in Fig. 1. The receiver wants to have an 
accurate measurement of a discrete random variable X G X, 
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where X denotes the set of all the possibilities. To this aim, 
the receiver deploys a sensor (which is a part of the sender) 
to provide a measurement of the variable. The measurement 
is denoted hy Z & X. The sender also has another discrete 
random variable denoted hy W & W, which is correlated 
with X and/or Z. This random variable is the sender’s private 
information, i.e., it is not known by the receiver. The sender 
wants to transmit a message Y & y that contains useful 
information about the measured variable while minimizing the 
amount of the leaked private information (note that, because of 
the correlation between W and X and/or Z, an honest report of 
Z may shine some light on the realization of W). Throughout 
this paper, for notational consistency, we use capital letters 
to denote the random variables, e.g., X, and small letters to 
denote a value, e.g., x. 

Assumption 1: The discrete random variables X, Z, W are 
distributed according to a joint probability distribution p : X x 
/f X yy —> [0,1], i.e., P{X = X, Z = z,W = tu} = p{x, z, w) 
for all {x, z,w) G X X X X W. 

The conflict of interest between the sender and the receiver 
can be modelled and analysed as a game. This conflict of 
interest can manifest itself in the following ways: 

1) In participatory-sensing schemes, the sender’s measurement 
of the state potentially depends on the way that the sender 
experiences the underlying process or services. For instance, 
in traffic estimation, the sender’s measurement is fairly 
accurate on the route that she has travelled and, thus, an 
honest revelation of Z provides a window into the life of the 
commuter. However, the underlying state X is not related 
to the private information of sender W since she is only an 
infinitesimal part of the traffic flow. In such a case, we have 

F{X = x,Z = z,W = w} 

= F{Z = z\X = x,W = tt;}P{X = x,W = w} 

= F{Z = z\X = x,W = tt;}P{X = x}F{W = w}, 

where the second equality follows from independence of 
random variables W and X. 

2) In many services, such as buying insurance coverage or 
participating in polling surveys, an individual should provide 
an accurate history of her life or beliefs. In these cases, the 
variable X highly depends on the private information of the 
sender W (if not equal to it). In such cases,the measurement 
Z may not contain any error as well. 

In what follows, the privacy game is properly defined. 

A. Receiver 

The receiver constructs its best estimate X G X using the 
conditional distribution P{2f = x\Y = y} = Pxy for all 
{x,y) G X xy. The matrix /3 = {^xy)(x,v)eXxy € B is the 
policy of the receiver with the set of feasible policies defined as 

B=lp:l3xy G [0,i],v(i,y) G T’ X y kY,Pxy=iyy G yV 

^ xex ' 

The receiver prefers an accurate measurement of the variable 
X. Therefore, the receiver wants to minimize the cost function 
X)} with the mapping d : X x X ^ IR>o being a 


measure of distance between the entries of set X. An example 
of such a distance is 


d{x, x) 


0, X = X, 
1, X ^ X. 


( 1 ) 


When using the distance mapping in (1), the term E{(i(A', X)} 
becomes the probability of error at the receiver. The results of 
this paper are valid irrespective of the choice of this mapping. 


B. Sender 

The sender constructs its message y G y according to the 
conditional probability distribution P{y = y\Z = z,W — 
w} = ayzw for all (y,z,w) G y x X x W. Therefore, the 
tensor a = (ayzw)(y,z,w)eyxXxw G A denotes the policy of 
the sender. The set of feasible policies is given by 

A = ja : ayzw G [0, l],V(y,z,w) G y x X x W 

& ^ Ctyzw = 1, V(z, w) G X xW 
y&y 

The sender wants to minimize E{d(X, 2f)} + gI{Y; W), with 
I{Y;W) denoting the mutual information between random 
variables Y and W [14], to strike a balance between trans¬ 
mitting useful information about the measured variable and 
minimizing the amount of the leaked private information. In 
this setup, the privacy ratio g captures the sender’s emphasis on 
protecting her privacy. For small g, the sender provides a fairly 
honest measurement of the state. However, as g increases, the 
sender provides a less relevant message to avoid revealing her 
private information through the communicated message. 


C. Equilibria 

The cost function of the sender is equal 

U{a, (3) = E{d{X, X)} + gI{Y; W), 


where 


I(Y; W) = '^Y^ P{y = y,W = w} 
y^y wGW 


X log 


F{Y = y,W = w} 
P{y = y}F{W = w} 


( 2 ) 


with P{r = y} = Y.wewJ2zexY.xexO‘y^^oP{x,z,w), 
F{W = w} = Yxex 2:, w), and 

F{Y = y,W = w} F{Y = y,W = w,Z = z} 

= F{Y = y\W = w,Z = z} 

X ¥{W = w^Z = z} 

= EE ayzwP{x,Z,w). 


Moreover, we have 

E{(/(2f, X)} = E = X, X = x} 

xGX xGX 
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with 

P{X = x,X = x} = P{X = x,X = x,Y = y} 
y&y 

= = x\X = x,Y = y}P{X =x,Y = y} 

yey 

= X! = x,Z = z,W = w} 

yey zexwew 

X F{X = x,Z = z,W = w} 

= EEE PxyayzwP{x,Z,w). 

yey zex wew 

Following these calculations, we can define mappings ^ : 3 I x 
B —> M and : xl —)• M such that 

aa,P) = E{d{X,X)} 

=EEEEE d{x, x)l3xyOlyxwP{x, Z, W) 

xex xex yey zex wew 

and 


C{a)=IiY;W) 

= E E (EE '^) 

yey wew ^ zex xex 

T.zex T.xex OiyzwP{x, z, w) 


X log 


iT,wew,zex,xex ayzwP{x, z, w))P{hF = w} 


Therefore, we can rewrite the costs of the sender and the 
receiver, respectively, as U{a,/3) = ^{a,/3) + g((a) and 
V{a,P) = ^(a,/?). Now, we can properly define the equi¬ 
librium of the game. 

Definition 1: (Nash Equilibrium): A pair (a*,/3*) € A x 
B constitutes a Nash equilibrium of the privacy game if 
(a*, /3*) G N with 


N = {(q;,/ 3) e a X B I U{a,l3) < U{a', I3),ya' € A 
V{a,fi) < y(a,/3'),V/3' € B}. 


Now, we are ready to present the results of the paper. 


III. Finding an Equilibrium 

As all signalling games [3], the privacy game admits a 
family of trivial equilibria known as babbling equilibria in 
which the sender’s message is independent of the to-be- 
estimated variable and the receiver discards sender’s message. 

Theorem 1: (Babbling Equilibria): Let a* G A be such 
that a*y^^ = l/\y\ for all {y,z,w) G 3^ x A x W. 
Further, let /3* G i? be such that = 1 for x G 

aTgma^xexJ2z'exJ2w'ewPi^^'<^'^^')- Then, [a*, fi*) con¬ 
stitutes an equilibrium. 

Proof: If the receiver does not use the transmitted mes¬ 
sage Y, the sender’s best policy is to minimize I{Y]W), 
which is achieved by employing a uniform distribution on 
y [14]. Furthermore, if the sender’s message is independent 
of {Z, W), the receiver’s best policy is to set her estimate to 
be equal to the element with maximum ex ante likelihood. ■ 

The messages passed at a babbling equilibrium are mean¬ 
ingless and do not contain any information. In what follows. 


Algorithm 1 The best-response dynamics for learning an 
equilibrium. 

Require: G A, G B 

I: for fc = 1,2,... do 
2 : if k is even then 

3: G argmin^g^ 

4: e- 

5: else 

6 : G argmin^g^ 

7: 3 - 

8 : end if 

9: end for 


we propose methods for capturing other equilibria of the game. 
To do so, we need to define a useful concept. 

Definition 2: (Potential Game [15], [16]): The privacy game 
admits a potential function T' : A x i? —> K if 

V{a,P) - V{a,P') = 4'(a,^) - 4'(a,/3'). 

U{a,P) - U{a',P) = 4'(a,/?) - 4'(a',/3), 

for all a, a' G A and /3, /3' G B. If the game admits a potential 
function, it is a potential game. 

The following simple, yet useful, lemma proves that the 
presented communication game admits a potential function. 

Lemma 2 (Potential Game): The privacy game admits the 
potential function 4 /( 0 ;,/3) = ^{a,P) + gC{c()- 

Proof: First, note that, for the receiver, we have 

V{a,P)-V{a,P') = ^(a,P)-^{a,P') = T'(a,/3)-T'(a,/?'), 

and 

U{a,P) - U(a',P) = C(a,/?) -f pC(a) - ^ia',P) - £»C(a') 

= T'(a,/5) - ^'(a',/5)- 

for all a, a' G A and /3, fi' G B. ■ 

The result of Lemma 2 provides the following numerical 
method for constructing an equilibrium of the game. 

Theorem 3: Any (a*,/3*) G argmin^jj^^^g^xB T'(a,/3) 
constitutes an equilibrium of the game. 

Proof: The proof follows from Lemma 2.1 in [16]. ■ 

Theorem 3 paves the way for constructing numerical meth¬ 
ods to find an equilibrium of the game. This can be done 
by employing the various numerical optimization methods to 
minimize the potential function. However, this is a difficult 
task as the potential function is not convex (it is only convex 
in each variable separately and not in both variables simulta¬ 
neously). We can simplify the construction of an equilibrium 
of the game for the special case where the transmitted message 
Y and the to-be-estimated variable X span over the same set. 

Theorem 4: Assume that y = X. Let fi' be such that 
P'-y = 1 if X = y and piy = Q if x f y. Moreover, let 
a' G argmin^g^[5(Q;,/3')-I-pC(ct)]- Then, (a',P') constitutes 
an equilibrium of the game. 

Proof: Note that P' means that X = Y with probability 
one, i.e., no data precessing is performed at the receiver. 
Clearly, if X = Y, the sender finds a' so that Y minimizes 
E{(i(Ar, y)} -f gI(W;Y). By definition, this is equivalent of 
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saying that a' € argmin^g^[^(a,/?') + £»C(q^)]- In rest of 
the proof, we show that the best response of the receiver is to 
use P'. We do this by reductio ad absurdum. Assume that there 
exists X constructed according to the conditional distribution 
P{X = x\y = y} = Pxy, for all x,y G X, such that 
E{(i(Ar, X)} < E{(i(Ar, y)} (because otherwise the receiver 
sticks to /3')- Following the data processing inequality from 
Theorem 2.8.1 [14, p.34], we have I{W;X) < I{W;Y). 
This shows that E{d(A:,X)} + gI{W;X) < E{d(X,y)} + 
qI{W;Y). This is evidently in contradiction with the optimal¬ 
ity of a'. ■ 

Remark 1: The proof of Theorem 4 reveals that the 
sender’s policy is the solution of the optimization problem 
minQ,g^ E{c?(2f, F)} + qI{W] Y). This problem is equivalent 
with solving min(jg^. 7 (^;i/.Y)<^ E{(i(2f, F)} where d is an 
appropriate function of g. Therefore, intuitively, the sender 
aims at providing an accurate measurement of the state X 
while bounding the amount of the leaked information. 

For more general cases, we can use a distributed learning 
algorithm to recover an equilibrium. An example of such 
a learning algorithm is the iterative best-response dynamics. 
Following this, we can construct Algorithm 1 to recover an 
equilibrium of the game distributedly. To present our results, 
we need to introduce a more practical notion of equilibrium. 

Definition 3: (e-Nash Equilibrium): For all e > 0, a pair 
{a*, P*) G Ax B constitutes an e-Nash equilibrium of the 
privacy game if {a*,P*) € with 

Afe = {{oi,P) G Ax B \ U{a,P) < U{a' ,P) + e,Va' G A 
V{a,P) < V{a,P') + e,yp' G B}. 

This notion of equilibrium means that each player cannot 
gain by more than e from unilaterally changing her actions, 
which is a practical notion if the act of changing her actions 
has “some cost” for the player. Now, we are ready to prove 
that Algorithm 1 can extract an e-Nash equilibrium. 

Theorem 5: For {(a^,/?^)}fceN generated by Algorithm 1 
and all e > 0, there exists G N such that G 

for all k > K^. 

Proof: The proof is done by reductio ad absurdum. To 
do so, assume that there exists an increasing subsequence 
{fczjzGN such that ^P^^) G N. If {a^,P^) A4 

for some A: > 3, at least one of the following cases hold. 

• Case 1 (3a' G A : U{a^,P^) > U{a',P^) + e and k is 
even): This means that P^ = P^~^. Thus, we know that there 
exists a' G A such that U(a',P^~^) < U, P^~^) — e. This 
is in contradiction with Line 3 of Algorithm 1 and, thus, will 
never occur. 

• Case 2 (3a' G A : U(a^,P^) > C/(a',/3^) 3- e and k is 
odd): In this case, we have 

T'(a'=+\/3''+i) - ^'(a^/3'') 

= T'(a'=+^/3'=)-T'(a^/3'=) 

= U{a^+^,P'')-U(a^,P^) fc-fliseven 
< U{a',P^) — U{a^,P^) Line 3 in Algorithm 1 


• Case 3 (3/3' G B : F(a^,/3^) > F(a*,/3') 3-e and k is 
even): In this case, we have 

T'(a'=+^/3'=+l)-T'(a^^'=) 

= T'(a'=,/3'=+i) - T'(a'=,/3'=) 

= V{a^,P^+^)-V{a^,P^) A:+ 1 is odd 

< F(a*,/3') — F(a^,/?*) Line 6 in Algorithm 1 

< -e. 

• Case 4 (3/3' G B : V{a^,P^) > V{a^,P') 3- e and k 

is odd): This means that 1. Lurther, we know that 

there exists /3' G A such that F(a^“^,/3') < V{a^~^, P^) — e. 
This is in contradiction with Line 6 of Algorithm 1 and, thus, 
will never occur. 

Lrom combining Cases 1^, we know that if (a^/3'=) ^ A4 
for some A; > 3, then /3^“''^) — T'(a^, P^) < —e. Note 

that, in general, by construction of Line 3 in Algorithm 1, if 
k is an even number, we get 

^(a^/3'')-^(a'=-^/3'=-l) 

= [/(a^ - C/(a'=-\ /3'=-i) < 0. (3) 

Similarly, by construction of Line 6 in Algorithm 1, if A: is an 
odd number, we have 

T'(a^/3'=)-T'(a'=-^/3'=-^) 

= Via^-^.P'^) - V(a^-^,P'^-^) < 0. (4) 

Therefore, we can deduce that 

lim T'(a'', /3'=)=T'(a°, /3°) tV [T'(a*+\ /3*+i)-T'(a‘, /3*)] 

fc—>-oo 

tGNu{0} 

zeN:fc^>3 
= — OO, 

which is in contradiction with that limfc_).oo T'(a^,/3^) exists, 
because, by (3) and (4), {T'(a*,/3^)}fcgN is a monotone 
decreasing sequence and is lower bounded by zero. ■ 

Theorem 5 shows that Algorithm 1 converges to an e-Nash 
equilibrium, for any e > 0, in a finite number of iterations. We 
can slightly tweak Algorithm 1 to also present bounds on the 
required number of iterations to extract an e-Nash equilibrium. 

Theorem 6: Lor {(a^,/3^)}fcgN generated by Algorithm 2 
and all e > 0, (a^,/3^) G Afe for all A: > 3 3- 'I'(a°,/3°)/e. 

Proof: Algorithm 2 makes sure that (a*,/3^) = 

(a^“^,/3^“^) if {a^,P^) G Afe- Therefore, there exists K 
such that (a^,P^) f. Afe for A: < AT — 1 and {q^,P^) G Afe 
for k > K. Now, following the reasoning of the proof of 
Theorem 5, we can see that 

K-l 

P^) =^{a\ P^) 3- ^ [vl/(a‘+i, /3‘+i) - T'(a*, /3‘)] 

t^2 

<T'(a^ P^)-{K - 3)e<T'(a°, /3°) - (AT - 3)e, 

where the last inequality follows from that T'(a*,/3^) is a 
decreasing sequence. Noting that , P^) > 0 because 

of the properties of the mutual information and expected 
estimation error, we can see that A" < 3 3- 4'(a°,/3°)/e. ■ 


< -e. 
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Algorithm 2 The best-response dynamics for learning an 

equilibrium. 

Require: e A, /3° e B 

1 : for /c = 1,2,... do 
2: if k is even then 

3: a'e argmin^g^ [/(a, 

4: if U — U{a', > e then 

5: a'" 3- a' 

6 : else 

7: 3- 

8 : end if 

9: 13'^ ^ 

10 : else 

11: € argmin^gg 

12 : if V — V{a'^~^,P') > e then 

13: P’" 3- 13' 

14: else 

15: (3^ 3- I3’"~'^ 

16 : end if 

17: 3- 

18 : end if 

19: end for 



Fig. 2. Communication structure between the senders , Sn and the 

receiver R. 

IV. Extension to Multiple Senders 

Here, we extend the results to the case where sender Si, 
1 <i < n, for some n > 2, communicate with the receiver R. 
Similarly, the receiver wants to have an accurate measurement 
of a random variable X ^ X. We assume that sender i has 
access to a possibly noisy measurement of the state denoted 
by Zi e X. The private information of the senders is denoted 
by Wi G Wi- The senders would like to transmit a message 
Yi G yi that contains useful information about the measured 
state Zi while minimizing the amount of the leaked private 
information. Let N = {1,..., n}. 

Assumption 2: The random variables X, (Zi)igN, (ITi)igN 
are distributed according to a joint probability distribution p : 

A X A" X n. 6 NW* ^ [ 0 : 1 ]’ i-e-’ = a:, = 

(2:i)i6N, (fVi)ieN = (iP*)*eN} = p(a;, (zj)jgN, (wi)ieN) for 
all {x, (zi)igN, (wi)i6N) G A X A" X n*eN 

Similarly, the receiver constructs its best estimate X G X 
using the conditional distribution P{A = ai|(Tj)igN = 
— (3xyi...yj, for all (^X, (jji'ji^jst^ G X Y. 

The tensor /3 = \l3xy^...yJ{x,{y,),^^)(iX-KY\,^^yi ^ B' is the 
policy of the receiver with the set of feasible policies defined as 

B' = {p-.Pxy,...y„ G [0,1],V(x,(j/,)*Gn)G Ax [] V. 

and ^ f3xyi...y„ = l,V(l/i)igN € Vi >. 

xex ieN 1 


Algorithm 3 The best-response dynamics for learning an 
equilibrium in the multi-sensor case. 

Require: q: 0)T g A for all i G N, /3° G i? 

I: for fc = 1,2, ... do 

2 : Select j G {0,1,..., n} uniformly at random 

3: if J = 0 then 

4: f3'^ G argmin^g^, V(/?, (aO)-'=-i)igN) 

5: Q;0).fc ^ a^'^kk-1 fQj- alH G N 

6 : else 

7: G argmin^O) 

8: Q; 0 ).fc ^ fQj- all i G N \ {j} 

9: /3'= ^ 

10 : end if 

11 : end for 


The receiver seeks an accurate measurement of the variable 
X and, hence, minimizes the cost function E{(i(A, X)}. 


The sender i G N constructs its message pi G Vi according 
to the conditional probability distribution PjE = yi\Z = 
z„W = Wi} = for all {yi,z„Wi) G Vi x A x Wi. 

The tensor = {ay}z,wi)(yi,zi,wi)(^y,y.xy.w, € A' denotes 
the policy of the sender. The set of feasible policies is 


A' 


|a« : G [0,1], V(y„ u;,) G W x A x W. 

and ^ <^y}ziWi = l,V(zi,Wi) G A x Wij. 
yi(^y^ ^ 


The sender wants to minimize E{c?(X, X)} + Ql{Yi-,Wi) to 
find a balance between transmitting useful information about 
the measured variable and maintaining her privacy. 

Remark 2: This formulation is useful when X and Wi 
are uncorrelated while Zi and lAi are correlated (e.g., 
participatory-sensing mechanisms for traffic estimation). This 
is because, in this formulation, the sender is only concerned 
about the amount of the leaked information in her own mes¬ 
sage I{Yi]Wi). However, if X and Wi were to be correlated, 
she should have been concerned with the total amount of the 
leaked information I{Yi, ..., Yn, Wi). This is indeed the case 
because the receiver can construct an accurate representation 
of the state (if each sensor is only concerned about the amount 
of the leaked information in her own message) and, therefore, 
gain an insight into the private information of the sensors. 

Following similar calculations as in Section III, the cost of 
the receiver is given by 


V((aW),eN, /?) = E{d(X, X)} = (a«).6N), 


where the mapping : B' x JlieN [^i 1] defined as 

in (5), on top of the next page, for all (/?, x B' x 

riieN sender j G N is given by 


[/,((a«)igN,/?) = EMX,X)} + qI{YaW,) 
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r(/3,(aW),eN)= E 

(yi ,zi jjui) e X A” X Wi 


E E d{x,x)l3xy^,„y.^ 

(yn,Zn,‘Wn)Gyn>^^ >^yVn 


n <^y}ziWiPix, (2;i)ieN, (w*)*gN) 
ieN 


(5) 


where 


C'(aW)= ^ ^ v{Y,=y„W,=w,} 

vj^yj wj^Wj 


X log 


p{y? = vj^Wj = wj} 

P{y, = yj}nw, = W,} 


Definition 4: (Nash Equilibrium): A pair ((Q(*)’*)igN,/3*) € 
riieN y ^ constitutes a Nash equilibrium of the privacy 
game if ((a(*^’*)igN, ,5*) G fif with 


N' = \ ((a«),eN,/3) e n X S' I Va(^') G A',Vj G N, 

iGN 

[/,((a«),eN,/3) < C/,(a«,(a('^)i6N\{,},/3), 

iGN, /3) < E((a«) ieN,/3),V/3 G -B'|. 


Definition 5: (Potential Game): The defined game admits a 
potential function T*' : HieN x i?' —> M if 

E((a«),eN,/3)-E((a«),eN,/3) 

= T''((a«),eN,/3)-'I'((aW),eN,/3), 
[/,((a«),eN,/3) - (a«),eN\m,/3) 

= vI-'((aW),gN,/3) - '!'(«('■), (a('^).6N\{,},/3), 

for al_l ((a(*))igN,/3) G Hjen x B' , G A' , j G N, 
and P G B'. If the game admits a potential function, it is a 
potential game. 

Lemma 7: The game admits the potential function 

T''((aW)ieN, /?) = r(/?, (a('))*6N) + 

Proof: The proof of this lemma is, mutatis mutandis, 
similar to that of Lemma 2. ■ 

Theorem 8: Any ((aW*)i6N,^*) in 

T''((aW),gN,/?) constitutes 

an equilibrium of the game. 

Proof: The proof follows from Lemma 2.1 in [16]. ■ 

Definition 6: (e-Nash Equilibrium): Lor all e > 0, a pair 
((Q;i*)’*)igN,/?*) G n A' X B' constitutes an e-Nash 
equilibrium of the privacy game if /3*) G 

with 

AC = I ((a('^).6N,/3) G n 4 X B' I G A',Vj G N, 

Uj{{a^"'>)ieTss, P)<Uj{a^^\ (Q;W)ieN\{i},/3)+e, 
V{ia^%e^,P) < l/((a«)^eNJ) + e,V^ G i?|. 


In the multi-sensor case, we can use Algorithm 3 to recover 
an equilibrium of the game using an iterative best-response 
dynamics. 

Theorem 9: Lor /3^)}feeN generated by Algo¬ 

rithm 3 and all e > 0, lim/j_).oo IP{((Q;^*^’^)iGN, /3 ^)gAC} = 1- 
Proof: The proof is done by reductio ad absurdum. To 
do so, assume that there exists an increasing subsequence 
{fczjzGN and a constant (5 > 0 such that P{) f. 


AC'} > d for all z G N. Lirst, note that, with a sim¬ 
ilar reasoning as in the proof of Theorem 5, we can 
show that, for all A: G N, — 

T''((aW>'=)ieN,/3'') < 0. Now, if (a'=,/3'=) ^ AC then, 

either 3f G N, 3a^ G A} : _> 

/3^) 3- e for some f G N or 3/3 G 
B' : L((aWA),gN,/3fc) > J) + e. if 3p G 

B' : + e and if j = 0, 

we get that T''((q;(*^A+ 1) ^fc+i) _ vI('((Q;(*)A)^gj^^ ^fc) < 
—e. Therefore, if Bfi G B' : L((a^*^A) > 

VP) + the inequality in (6), on top of the next 
page, holds. Similarly, if 3a^ G A} : > 

[/<;(q;(^C _p g and if j = I, we get that 

T''((a«>''+i)ieN,/3''+^) - < _g^ which 

leads to the inequality (6). Notice that 

lim E{vI/((aWA).^^^;jfc)} 

k—foo 

=E{^iia^^'>%^^,p^)} 

OO 

E{n/((a«’‘+i)ieN, /3‘+i)-T-((aW>‘),eN, /3‘)} 

t^O 

OO 

- e/{n + 1 ) ^ 

z^O 

= — OO. 

This is in contradiction with that limfc_).oo /3^)} ex¬ 

ists and is greater than or equal to zero. Thus, we have proved 
that limfc_).ooP{(Q:'',/3'") ^ AC) = 0. ■ 

V. Numerical Example 

Consider an example with X = W = y = {!,...,5}. 
Assume that Z = X, i.e., the sender has access to the perfect 
measurement of X. Moreover, let 

(P{A: = x,W =w})x(ix,w(iW 
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This distribution implies that there is a reasonable correlation 
between X and W. Therefore, for high enough g, we expect a 
very bad estimation quality (at the receiver) since, otherwise, 
the receiver can recover X, which carries a significant amount 
of information about W. 

Lor this example, we use the results of Theorem 4 extract a 
nontrivial equilibrium for each g. Lig. 3 (top) illustrate the es¬ 
timation error E{d(2f, Xf} as a function of the privacy ratio g. 
As we expect, by increasing g, the sender puts more emphasis 
on protecting her privacy rather than providing a useful mea¬ 
surement to the receiver and, therefore, E{fi(A', A')} increases. 
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E{v|/'((aW’'=+i),eN, /3"')} = ^ E{vI/'((a«''=+i),gN, /3"+')-^'((a^*^’")^GN, /3")|j = 9}P{j = q} 

9=0 

<-e/(n + l). (6) 




Fig. 3. Expected estimation eiTor E{d(X,X)} and mutual information 
I{Y\W) at the extracted equilibrium versus the privacy ratio g. 

Fig. 3 (bottom) shows the mutual information I(Y-,W) as a 
function of the privacy ratio g. Evidently, with increasing g, 
the amount of leaked information about the private information 
of the sender decreases. In both figures, there seems to be 
sudden change when the privacy ratio passes the critical value 
g = 0.38. That is, for all g < 0.38, the truth-telling seems 
to be an equilibrium of the game; however, if p > 0.38, the 
sender adds false reports to protects her privacy. 

VI. Conclusion 

We developed a game-theoretic framework to investigate the 
effect of privacy in the quality of the measurements provided 
by a well-informed sender to a receiver. We used a privacy 
ratio to model the sender’s emphasis on protecting her privacy. 
Equilibria of the game were constructed. We proposed learning 
algorithms for recovering an equilibrium. Euture work can 
focus on extending the results to dynamic estimation problems. 

References 

[1] V. P. Crawford and J. Sobel, “Strategic information transmission,” 
Econometrica: Journal of the Econometric Society, pp. 1431-1451, 
1982. 

[2] J. Fan'ell and M. Rabin, “Cheap talk,” The Journal of Economic 
Perspectives, pp. 103-118, 1996. 

[3] J. Sobel, “Signaling games,” in Computational Complexity, R. A. Mey¬ 
ers, Ed. Springer New York, 2012, pp. 2830-2844. 

[4] F. Farokhi, H. Sandberg, I. Shames, and M. Cantoni, “Quadratic gaussian 
privacy games,” 2015. 

[5] C. Dwork, “Differential privacy: A survey of results,” in Theory and 
Applications of Models of Computation, ser. Lecture Notes in Computer 
Science, M. Agrawal, D. Du, Z. Duan, and A. Li, Eds. Springer Berlin 
Heidelberg, 2008, vol. 4978, pp. 1-19. 

[6] A. Friedman and A. Schuster, “Data mining with differential privacy,” 
in Proceedings of the 16th ACM SIGKDD International Conference on 
Knowledge Discovery and Data Mining, 2010, pp. 493-502. 

[7] C. Dwork and J. Lei, “Differential privacy and robust statistics,” in Pro¬ 
ceedings of the 41st Annual ACM Symposium on Theory of Computing, 
2009, pp. 371-380. 


[8] A. D. Wyner, “The wire-tap channel,” Bell System Technical Journal, 
The, vol. 54, no. 8, pp. 1355-1387, 1975. 

[9] S. Tatikonda and S. Mitter, “Control under communication constraints,” 
IEEE Transactions on Automatic Control, vol. 49, no. 7, pp. 1056-1068, 
2004. 

[10] H. Ishii and B. A. Francis, Limited Data Rate in Control Systems 
with Networks, ser. Lecture Notes in Control and Information Sciences. 
Springer Berlin Heidelberg, 2003. 

[11] N. C. Martins and M. Dahleh, “Feedback control in the presence of 
noisy channels: “Bode-like” fundamental limitations of performance,” 
IEEE Transactions on Automatic Control, vol. 53, no. 7, pp. 1604—1615, 
2008. 

[12] N. C. Martins, M. Dahleh, and J. C. Doyle, “Fundamental limitations 
of disturbance attenuation in the presence of side information,” IEEE 
Transactions on Automatic Control, vol. 52, no. 1, pp. 56-66, 2007. 

[13] J. Baillieul and R J. Antsaklis, “Control and communication challenges 
in networked real-time systems,” Proceedings of the IEEE, vol. 95, no. 1, 
pp. 9-28, 2007. 

[14] J. A. Thomas and T M. Cover, Elements of Information Theory, 2nd ed., 
ser. Wiley Series in Telecommunications and Signal Processing. Wiley- 
Interscience, 2006. 

[15] R. W. Rosenthal, “A class of games possessing pure-strategy nash 
equilibria,” International Journal of Game Theory, vol. 2, no. 1, pp. 
65-67, 1973. 

[16] D. Monderer and L. S. Shapley, “Potential games,” Games and economic 
behavior, vol. 14, no. 1, pp. 124-143, 1996. 











